Device and method for rendering and delivering 3-D content

ABSTRACT

A device and method are provided for delivering three-dimensional (3-D) content. The device includes a receiving unit configured to receive a first signal containing at least two-dimensional (2-D) content, a processing unit configured to (i) determine an amount of a difference in the content in the first signal to be visualized by a left visual sensor and a right visual sensor, (ii) determine whether the amount of the difference is less than or equal to a predetermined minimum value, and to discard the signal to be visualized by one of the right and left visual sensors when the amount is determined to be less than or equal to the predetermined minimum value, and (iii) generate a second signal containing the 2-D content of the first signal and 3-D content in which the first signal to be visualized by the one of the right and left visual sensors is discarded.

RELATED APPLICATIONS

This application claims priority as a non-provisional application toU.S. Patent Application No. 61/495,140 filed on Jun. 9, 2011 and U.S.patent application No. 61/529,908 filed on Aug. 31, 2011, the entirecontents of which are hereby incorporated by reference in theirentirety.

FIELD

The present disclosure relates to a device and method for deliveringthree-dimensional (3-D) content.

BACKGROUND INFORMATION

Viewing 3-D content provides viewers with a more fulfilling experienceas compared to viewing 2-D content. However, there are problemsassociated with 3-D media creation, enhancement, and transmission, suchas bandwidth limitations and discomfort and/or disorientation problems(e.g., headaches), associated with the viewing of 3-D media, especiallymovies, delivered by conventional techniques.

There is a bandwidth consumption issue with conventional techniques dueto the existence of signal differences between standard 2-Dtransmissions and 3-D transmissions. For instance, 2-D and 3-D signalsfor the same program are transmitted on different communication channelsusing conventional techniques. This effectively requires at least twicethe amount of bandwidth for the same program. Furthermore, some peoplecomplain of headaches, discomfort, fatigue, disorientation and otherrelated maladies when watching stereoscopic 3-D movies or playing 3-Dgames for more than a few minutes.

SUMMARY

An exemplary embodiment of the present disclosure provides a device fordelivering three-dimensional (3-D) content. The exemplary deviceincludes a receiving unit configured to receive a first signalcontaining at least two-dimensional (2-D) content. The exemplary devicealso includes a processing unit configured to (i) determine an amount ofa difference in the content in the first signal to be visualized by aleft visual sensor and a right visual sensor, (ii) determine whether thedifference is less than or equal to a predetermined minimum value, (iii)discard a portion of the first signal to be visualized by one of theleft visual sensor and the right visual sensor corresponding to theamount of the difference when the amount of the difference is determinedto be less than or equal to the predetermined minimum value, and (iv)generate a second signal containing the 2-D content of the first signaland 3-D content in which the portion of the first signal to bevisualized by the one of the left visual sensor and the right visualsensor is discarded.

An exemplary embodiment of the present disclosure provides a method fordelivering three-dimensional (3-D) content. The exemplary methodincludes receiving a first signal containing at least two-dimensional(2-D) content, and determining, in a processing unit of a computerizeddevice, an amount of a difference in the content in the first signal tobe visualized by a left visual sensor and a right visual sensor. Theexemplary method also includes determining, in the processing unit,whether the amount of the difference is less than or equal to apredetermined minimum value. In addition, the exemplary method includesdiscarding, in the processing unit, a portion of the first signal to bevisualized by one of the left visual sensor and the right visual sensorcorresponding to the amount of the difference when the amount of thedifference is determined to be less than or equal to the predeterminedminimum value. Furthermore, the exemplary method includes generating, inthe processing unit, a second signal containing the 2-D content of thefirst signal and 3-D content in which the portion of the first signal tobe visualized by the one of the left visual sensor and the right visualsensor is discarded.

An exemplary embodiment of the present disclosure provides anon-transitory computer-readable recording medium having a computerprogram recorded thereon that causes a processor of computing device todeliver three-dimensional (3-D) content. The program causes theprocessor to execute operations comprising: receiving a first signalcontaining at least two-dimensional (2-D) content; determining an amountof a difference in the content in the first signal to be visualized by aleft visual sensor and a right visual sensor; determining whether theamount of the difference is less than or equal to a predeterminedminimum value; discarding a portion of the first signal to be visualizedby one of the left visual sensor and the right visual sensorcorresponding to the amount of the difference when the amount of thedifference is determined to be less than or equal to the predeterminedminimum value; and generating a second signal containing the 2-D contentof the first signal and 3-D content in which the portion of the firstsignal to be visualized by the one of the left visual sensor and theright visual sensor is discarded.

An exemplary embodiment of the present disclosure provides a method forenhancing three-dimensional (3-D) content. The exemplary method includesdetermining, in a processing unit of a computerized device, an amount ofa difference in 3-D content to be visualized by a left visual sensor anda right visual sensor. The exemplary method includes determining, in theprocessing unit, whether the amount of the difference is less than orequal to a predetermined minimum value. The exemplary method alsoincludes automatically outputting a notification of an anomaly in the3-D content if the difference is determined to be less than or equal tothe predetermined minimum value. In addition, the exemplary methodincludes correcting the anomaly such that the difference in the 3-Dcontent is made to be less than the predetermined minimum value.

An exemplary embodiment of the present disclosure provides anon-transitory computer-readable recording medium having a computerprogram recorded thereon that causes a processor of computing device toenhance three-dimensional (3-D) content. The program causes theprocessor to execute operations comprising: determining an amount of adifference in 3-D content to be visualized by a left visual sensor and aright visual sensor; determining whether the amount of the difference isless than or equal to a predetermined minimum value; automaticallyoutputting a notification of an anomaly in the 3-D content if the amountof the difference is determined to be less than or equal to thepredetermined minimum value; and correcting the anomaly such that thedifference in the 3-D content is made to be less than the predeterminedminimum value.

BRIEF DESCRIPTION OF THE DRAWINGS

Additional refinements, advantages and features of the presentdisclosure are described in more detail below with reference toexemplary embodiments illustrated in the drawings, in which:

FIG. 1 is an explanatory diagram illustrating how humans perceiveobjects in three dimensions (3-D);

FIG. 2 is a block diagram of components according to an exemplaryembodiment of the present disclosure;

FIG. 3 is an explanatory diagram illustrating how one view (either leftor right) can be redacted to save bandwidth, according to an exemplaryembodiment of the present disclosure;

FIG. 4 is a block diagram of an exemplary embodiment of the presentdisclosure;

FIG. 5 is a block diagram of an exemplary embodiment of the presentdisclosure;

FIG. 6 is a flowchart of an exemplary method and/or software algorithmexecuted by a processor according to an exemplary embodiment of thepresent disclosure;

FIG. 7 is a pictorial diagram conveying exemplary features of the SEESgraphical user interface (GUI); and

FIGS. 8( a) and (b) are explanatory diagrams illustrating exemplaryfeatures of the present disclosure in processing a signal received froma legacy source to reduce the redundant portion of the signal that is tobe viewed by two visual sensors.

FIG. 9 is a block diagram of an exemplary embodiment in which threecameras are positioned approximately at 120 degree spacing around anobject.

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS

As noted above, at the present time, separate communication channels areused for 2-D and 3-D programs, necessitating the dedication of two (ormore) separate communication “channels” to deliver the same media inboth formats. Exemplary embodiments of the present disclosure solve thisbandwidth consumption issue by transmitting a 2-D signal of content anda portion of a 3-D signal of that content, where the portion of the 3-Dsignal contains the difference between the 2-D and 3-D signals of thecontent, over the same communication channel. As discussed in furtherdetail below, exemplary embodiments of the present disclosure discardthe redundant portion of 2-D signals to be visualized by a first visualsensor (e.g., a first eye/camera) and a second visual sensor (e.g., asecond eye/camera). The exemplary embodiments of the present disclosuresubstantially reduce the issue of excess bandwidth consumptionassociated with conventional techniques and thereby dynamically increasethe amount of content that can be delivered within the same bandwidthallocation, while maintaining full compatibility with standard 2-DTV/HDTV signaling. The bandwidth saving techniques of the presentdisclosure also save bandwidth and improve the performance of3-D-enabled fixed and mobile computing devices such as personalcomputers (PCs) and all manner of mobile internet devices (MIDs), e.g.,netbooks, tablets, smartphones, and portable media players (PMPs).

As also noted above, some people complain of headaches, discomfort,fatigue, disorientation and other related maladies when watchingstereoscopic 3-D movies or playing 3-D games for more than a fewminutes. Exemplary embodiments of the present disclosure address theseproblems at two levels, (1) the manual, automated, and semi-automatedediting level, and (2) at the transmission Head End.

Exemplary embodiments of the present disclosure provide a bandwidthefficient 3-D transmission and content delivery system for rendering anddelivering 3-D content (e.g., stereographic/holographic 3-Dentertainment and information) to viewers over multiple distributionsystems, including, but not limited to: (1) radio frequency (RF)broadcast over-the-air; (2) cable and fiber optic distribution systems;(3) Internet delivery via TCP/IP and/or other Internet protocols; (4)satellite television delivery systems; (5) locally generated effects(i.e., 3-D effects generated and/or modified in the end user's displaydevice); and (6) called-for exaggerated or custom 3-D effects.

Referring to FIG. 1, due to interocular spacing D 106 (e.g., about 2.5inches on average) of the eyes, stereoscopic 3-D is seen by humans for adistance of a few inches up to about 30 feet, which varies from personto person, in the central portion of a person's field of view 101(without moving their head, but rather only their eyes 104 105), forminga convergence angle α 102 of about 28° on average, where the image fromboth eyes falls upon approximately the same region of each retina(respectively). Beyond that distance, a person's eyes can focus, but thebrain is forced to use other clues, such as size, position andperspective to determine distance, as the view from each eye willessentially have the same perspective and a person only “sees” in 2-D inthis region 103. When objects are closer to a person's face than theeyeballs can swivel to converge, double-vision takes place as the imagefrom each eye's lenses will no longer fall on the same area of eacheye's retina, respectively.

FIG. 2 is a block diagram of components according to an exemplaryembodiment of the present disclosure, and FIG. 3 is an explanatorydiagram illustrating how one view (either left or right) can be redactedto reduce bandwidth consumption, according to an exemplary embodiment ofthe present disclosure. With reference to FIGS. 2 and 3, a high-speedimage processor(s) (e.g., processing unit) comprised in a processingunit (e.g., a Head End 201) determines the difference between what theleft eye/camera 301 (e.g., left visual sensor) will see and what theright eye/camera 302 (e.g., right visual sensor) will see. When thatdifference reaches (e.g., less than or equal to) a predetermined minimumvalue (e.g., as the eyes gaze beyond the 3-D region of space 303 intothe 2-D region of space 304 within the viewer's perceivedline-of-sight), the portion of the images (corresponding to the amountof the difference) destined for one eye from one lens/camera (either 301or 302) will be discarded, leaving a comparatively small difference tobe transmitted/propagated/generated in order to produce simulated the3-D effect in the viewer's brain. The Head End 201 is configured totransmit a signal 202 which includes a standard digital signal from onelens (for 2-D displays 203) plus the 3-D difference from the other lens(for 3-D displays 204) after the original signal 205 has been processedat the Head End 201. Original and/or locally-generated effects canoriginate in either (1) the Head End 201 and legacy signal sources(e.g., satellite, cable/fiber optics, terrestrial RF, Internet, etc.)205 will not be required; or (2) within the computational capability ofthe television (TV), high-definition TV (HDTV), personal computer (PC),mobile Internet Device (MID), and/or portable media player (PMP) itself.

It is to be understood that a processor as described herein isspecifically configured to perform the functions of the exemplaryembodiments described herein. For example, the processor can be ageneral-purpose processor which executes a computer program recorded ona non-transitory computer-readable recording medium (e.g., ROM, harddisk drive, optical memory, flash memory, etc.). Alternatively, theprocessor can be an application specific processor configured to performthe functions of the exemplary embodiments described herein.

FIG. 4 is a block diagram of an exemplary embodiment of the presentdisclosure. As illustrated in FIG. 4, the combined 2-D and 3-D signals401 include a 2-D signal 402 that: (1) can be received and displayed bystandard 2-D devices 404 as 2-D images (the composite signal from onelens, not blurred, will be displayed); and (2) a 3-D signal 403 that canbe received and displayed by standard 3-D enabled devices 405 as 3-Dimages (the composite signal from one lens plus the difference signalfrom the other lens will allow for the full 3-D effect to be viewed).The Head End 406 is configured to convert 2-D images from legacy sources407 (e.g., satellite, cable/fiber optics, terrestrial RF, Internet,etc.) to 3-D images in real-time so they can be displayed as 3-D imageson 3-D enabled devices.

FIG. 5 illustrates an exemplary embodiment of the present disclosure inwhich the system originating at the processing unit (e.g, Head End 501)may or may not require a special set-top box 502 to interpret its signal503 before it—in a further processed form 504—ultimately reaches adisplay 505.

Accordingly, exemplary embodiments of the present disclosure provide adevice for delivering 3-D content. The exemplary device includes areceiving unit configured to receive a first signal containing at least2-D content. The receiving unit can be included in the Head End 201, 406in FIGS. 2 and 4, for example. Alternatively, the receiving unit can bean external component to the Head End. The receiving unit is configuredto receive the first signal from a legacy signal source (e.g., 205, 407in FIGS. 2 and 4) including at least one of satellite, RF cable, fiberoptics, terrestrial RF and the Internet. The exemplary device alsoincludes a processing unit configured to determine an amount of adifference in the content in the first signal to be visualized by a leftvisual sensor (e.g., eye/camera 104, 301 in FIGS. 1 and 3) and a rightvisual sensor (e.g., eye/camera 105, 302 in FIGS. 1 and 3), to determinewhether the amount of the difference is less than or equal to apredetermined minimum value, and to discard a portion of the firstsignal to be visualized by one of the left visual sensor and the rightvisual sensor corresponding to the amount of the difference when theamount of the difference is determined to be less than or equal to thepredetermined minimum value. According to an exemplary embodiment, thepredetermined minimum value represents when one of the first visualsensor and the second visual sensor visualize the content in the firstsignal beyond a 3-D region of space into a 2-D region of space. Inaddition, the processing unit is configured to generate a second signalcontaining the 2-D content of the first signal and 3-D content in whichthe portion of the first signal to be visualized by the one of the leftvisual sensor and the right visual sensor is discarded. The exemplarydevice also includes a transmitting unit configured to transmit thesecond signal to at least one of a 2-D enabled device (e.g., 203, 404 inFIGS. 2 and 4) and a 3-D enabled device (e.g., 204, 405 in FIGS. 2 and4).

FIGS. 8( a) and (b) are explanatory diagrams illustrating exemplaryfeatures of the present disclosure in processing a signal received froma legacy source to discard a redundant portion of the signal that is tobe viewed by both visual sensors. FIG. 8( a) illustrates an example of afirst signal 820 received by the receiving unit of the exemplary deviceof the present disclosure from a legacy source. The first signal 820 caninclude two related 2-D signals collectively constituting 3-D content.For instance, a first visual sensor (e.g., camera lens 822) can capturea first 2-D signal containing content represented between points A to Cof the signal 820 in FIG. 8( a), and a second visual sensor (e.g.,camera lens 824) can capture a second 2-D signal containing contentrepresented between points B to D of the signal 820 in FIG. 8( a). Thesefirst and second 2-D signals collectively constitute 3-D contentrepresented between points A to D of the signal 820 in FIG. 8( a). FIG.8( a) also illustrates how a first visual sensor 822 (e.g., left eye)would view a slightly different portion of the 3-D content than a secondvisual sensor 824 (e.g., right eye) based on the interocular spacing D.The dotted lines in FIG. 8( a) represent the different portions to bevisualized by the first and second visual sensors 822, 824.

FIG. 8( b) is an exploded perspective view illustrating the differentportions of the 3-D content to be viewed by the first and second visualsensors (e.g., left and right eyes) 822, 824. Reference symbol 830 inFIG. 8( b) designates a component of the 2-D signal 820 containing theportion of the 3-D content to be visualized by the first visual sensor822 (e.g., left eye), and reference symbol 840 in FIG. 8( b) designatesa component of the 2-D signal 820 containing the portion of the 3-Dcontent to be visualized by the second visual sensor 824 (e.g., righteye). As illustrated in FIG. 8( b), the left and right eyes would bothvisualize a common portion C of the 3-D content. However, the left eye822 would visualize a portion Δ1 of the 3-D content that is notvisualized by the right eye 824 due to the interocular spacing D, andthe right eye 824 would visualize a portion Δ2 of the 3-D content thatis not visualized by the first visual sensor 822 due to the interocularspacing D. Accordingly, reference symbol C designates the common(redundant) portion of the 3-D signal to be viewed by both the first andsecond visual sensors (e.g., left and right eyes, respectively) 822,824.

In accordance with an exemplary embodiment of the present disclosure,the processing unit of the device determines an amount of a differencein the content in the first signal 820 to be visualized by the firstvisual sensor 822 and the second visual sensor 824. The processing unitdetermines whether the amount of the difference is less than or equal toa predetermined minimum value (e.g., when one of the first visual sensorand the second visual sensor visualize the content in the first 2-Dsignal beyond a 3-D region into a 2-D region of the space). In thepresent example, the processing unit determines that the amount of thedifference C to be viewed by one of the visual sensors (e.g., the righteye 824) is less than the predetermined minimum value, because both thefirst and second visual sensors 822, 824 will view the common portion Cbeyond a 3-D region into a 2-D region of space. Accordingly, theprocessing unit discards the portion C of the first 2-D signal 820 to beviewed by one of the visual sensors (e.g., the right eye 824) upondetermining that the amount of the difference is less than or equal tothe predetermined minimum value. In the present example, the processingunit discards the common portion C of component 840 of the 2-D signal820, since that common portion C is contained in the component 830 of2-D signal 820. The processing unit then generates a second signalcontaining (i) the 2-D content of component 830 of 2-D signal 820 (i.e.,portion Δ1 plus common portion C of component 830) to be viewed by thefirst visual sensor 822 (e.g., left eye), and (ii) 3-D contentcontaining portion Δ2 of component 840 to be visualized by the secondvisual sensor 840 (e.g., right eye). The common portion C of the first2-D signal 820 to be visualized by the second visual sensor 824 isdiscarded and not included in the 3-D content of the second signal,since the common portion C of the first 2-D signal 820 is included inthe 2-D component 830 of 2-D signal 820. Accordingly, in the presentexample, the second signal generated by the processing unit contains (i)component 830 of the 2-D signal 820 to be visualized by the left visualsensor (Δ1+C), and (ii) 3-D content (Δ2) in which the common (redundant)portion C of component 840 has been discarded. In the foregoing example,it was described that the common portion C contained in component 840 tobe visualized by the second visual sensor (e.g., right eye) is discardedin creating the 3-D content of the second signal, since the commonportion C is contained in component 830 included in the 2-D signal 820.The present disclosure is not limited to this example. For example, thesecond signal can be generated to include (i) component 840 of the 2-Dsignal 820 to be visualized by the right visual sensor (Δ2+C), and (ii)3-D content (Δ1) in which the common portion C of component 830 isdiscarded.

In accordance with an exemplary embodiment, the predetermined minimumvalue can be a fixed value or it can be dynamically adjusted. Forexample, the predetermined minimum value can be adjusted for differentscenes so that more or less of the common portion C of the first signal820 to be viewed by the left and right visual sensors can be discardedwhen generating the second signal. The predetermined minimum value canalso be adjusted for a difference in interocular spacing D and/or adifference in the spacing between camera lenses for capturing thecontent. The processing unit can automatically adjust the predeterminedminimum value, for example, upon determining a scene change. Thepredetermined minimum value can also be adjusted upon receiving acontrol input, for example, from an operator of the exemplary device.

In accordance with an exemplary embodiment, the receiving unit,processing unit and transmitting unit can be provided in a singledevice, such as the Head End 201, 406 in FIGS. 2 and 4, for example.According to another exemplary embodiment, the receiving unit,processing unit and/or transmitting unit can be provided in differentdevices in the distribution stream between the legacy source and amultimedia device configured to display the second signal. For example,the receiving unit can be provided in a Head End while the processingunit is provided in a multimedia device (e.g., a television, set-topbox, computer, mobile Internet device, portable media player, etc.)configured to display the second signal. Accordingly, the receiving,processing and transmitting functions can be located virtually anywherein the distribution stream, such as before the cable, satellite, ISPHead End, at the Head End, or at the subscriber location in a set-topbox connected to or integrally installed in a display device. Therefore,it is to be understood that the receiving, processing and transmittingfunctions of the exemplary embodiments disclosed herein can be performedin one or several devices in the distribution stream.

In the exemplary embodiments described above, the 2-D signal and thenon-redundant portion of the 2-D signal which is not subtracted(discarded) were described as being transmitted on the samecommunication channel. According to an exemplary embodiment, the 2-Dsignal can be transmitted on a first communication channel, while thenon-redundant portion of the 2-D signal which is not subtracted can betransmitted on a second communication channel distinct from the firstcommunication channel.

In accordance with an exemplary embodiment, the device of the presentdisclosure can also include a recording unit configured to record thegenerated second signal containing the 2-D signal and the non-redundantportion of the 2-D signal which is not discarded onto a non-transitoryrecording medium, such as a DVD-ROM, BD-ROM, hard disk drive of aportable multimedia player, etc., for distribution of the second signal.In addition to recording the second signal containing the 2-D signal andthe non-redundant portion of the 2-D signal which is not discarded, thesecond signal can also be transmitted via wired and/or wirelesselectronic distribution mediums through public networks such as theInternet, as well as private networks such as Intranets, for example.Due to the reduced data size of the second signal, as compared to therecording and transportation of conventional 3-D signals, the presentdisclosure enables a reduced downloading and/or transmitting time, aswell as a reduction in computer storage requirements. Accordingly, thepresent disclosure enables devices to be able to store, download and/ortransmit more information as compared to conventional 3-D techniques.Use of this reduced bandwidth technique according to the exemplaryembodiments of the present disclosure can extend to, for example, allforms of professional and consumer digital stereo 3D production,storage, transmission and display equipment, including computers, 3Dcameras, editing, and/or projection and delivery systems. In accordancewith an exemplary embodiment of the present disclosure, the redundantportion of a 2-D signal from one or more visual sensors is discarded,while the non-redundant portion is saved. The non-redundant portionamounts to a difference between two or more 2-D signals. Accordingly, itis to be understood that the exemplary embodiments of the presentdisclosure provide for a technique of lossless redundant data removalfor delivering 3-D content, where the difference between two or more 2-Dsignals is saved, while redundant portions of these 2-D signals arediscarded in accordance with the above-described exemplary embodiments.

In accordance with an exemplary embodiment, the device of the presentdisclosure can also transmit information identifying the redundantportion of the 2-D signal which is discarded from the 3-D portion of thesecond signal, so that a 3-D enabled device receiving the second signalcan reconstruct the 3-D content for display of the portion of the 3-Dcontent which was discarded. For instance, with reference to theabove-described example in FIGS. 8( a) and (b), the common portion C ofcomponent 840 of 2-D signal 820 was discarded in creating the 3-Dcontent of the second signal, since the common portion C of component840 is also contained in component 830 of the 2-D signal which isincluded in the second signal. In generating the second signal, theprocessing unit can also transmit information and/or include informationwith the second signal which identifies the common portion C of thesecond signal so that a 3-D enabled device can accurately reconstructthe 3-D content and display the common component for the visual sensor(e.g., right eye) for which the common component was discarded ingenerating the second signal.

In accordance with an exemplary embodiment, the device of the presentdisclosure can also include a compression unit configured to compressthe generated second signal containing the 2-D signal and thenon-redundant portion of the 2-D signal which is not discarded. Inaccordance with an exemplary embodiment, the compression unit can becomprised in the processing unit, or it can be a separate component ofthe processing device. The compression unit can compress the generatedsecond signal according to any predetermined compression technique, suchas MPEG-4, H.264, VC-2, for example. The compression of the secondsignal can further reduce the amount of data to be transmitted and/orrecorded by the above-described transmitting unit and recording unit,respectively. In addition, an exemplary embodiment of the presentdisclosure also provides that the compression unit can compress theindividual 2-D signals prior to the generation of the second signal. Forinstance, an exemplary embodiment of the present disclosure providesthat the compression unit can compress the 2-D signals received frommultiple cameras, and then the redundant portion of one or more of the2-D signals is discarded in accordance with the above-describedexemplary embodiments.

The exemplary embodiments described with reference to FIGS. 8( a) and(b) utilize two cameras. Exemplary embodiments of the present disclosurealso provide for multi-camera applications that have more than two 2-Dviews. FIG. 9 illustrates an example in which three cameras 910 ₁, 910₂, 910 ₃ are positioned approximately at 120 degree spacing around anobject 920. Consistent with the techniques of the above-describedexemplary embodiments, the bandwidth-reducing techniques of the presentdisclosure can be implemented in this multi-camera application byreceiving individual 2-D signals from the three cameras 910 ₁, 910 ₂,910 ₃, respectively, and discarding any redundant portion of the 2-Dsignals which overlap the corresponding 2-D signal obtained by aneighboring camera. For example, as illustrated in FIG. 9, there existsa common portion C₁₋₂ between the 2-D signal 931 obtained by camera 910₁ and the 2-D signal 932 obtained by camera 910 ₂. In addition, thereexists a common portion C₂₋₃ between the 2-D signal 932 obtained bycamera 910 ₂ and the 2-D signal 933 obtained by camera 910 ₃.Furthermore, there exists a common portion C₁₋₃ between the 2-D signal931 obtained by camera 910 ₁ and the 2-D signal 933 obtained by camera910 ₃. In accordance with the exemplary embodiments of the presentdisclosure, the common portions of one of the pairs of theabove-described signals containing a common portion can be discarded ingenerating the second signal. For example, in generating the secondsignal containing a 3-D signal, the common portion C₁₋₂ can be discardedfrom the 2-D signal 932 obtained by camera 910 ₂, the common portionC₂₋₃ can be discarded from the 2-D signal 933 obtained by camera 910 ₃,and the common portion C₁₋₃ can be discarded from the 2-D signal 931obtained by camera 910 ₁. In this example, the second signal containing3-D content of the 2-D signals 931, 932 and 933 includes: (i) 2-D signal931 in which the common portion C₁₋₃ was discarded, (ii) 2-D signal 932in which the common portion C₁₋₂ was discarded, and (iii) 2-D signal 933in which the common portion C₂₋₃ was discarded. The 3-D signal thusobtained contains multiple 2-D signals, but common portions between the2-D signals may be discarded in accordance with the exemplaryembodiments of the present disclosure. The present disclosure is notrestricted to the above example. For instance, the common portion C₁₋₂can alternatively be discarded from the 2-D signal 931 obtained bycamera 910 ₁, the common portion C₂₋₃ can be discarded from the 2-Dsignal 932 obtained by camera 910 ₂, and the common portion C₁₋₃ can bediscarded from the 2-D signal 933 obtained by camera 910 ₃. Inaccordance with this exemplary embodiment, a viewer could rotate the 3-Dimage to view three or more sides of the object 920. For example, theviewer could rotate the image using the generated second signal since itis a 3-D signal constituting a compilation of the signals 931-933.Depending on the camera positions, the 3-D image constituting acompilation of signals 931-933 could enable the viewer to rotate theimage as a look-around image and thereby see multiple, if not all, ofthe sides of the object(s) captured by the multiple cameras. FIG. 9illustrates an example in which the cameras 910 ₁, 910 ₂, 910 ₃ are in arelative lateral plane. However, the present disclosure is not limitedto this example. The multi-camera application of the present disclosurecan include cameras at any desired placement. For example, a camera canbe placed above an object (e.g., a satellite camera), and multiplecameras can be placed on the ground at various heights and distancesrelative to the object to be viewed. Such a multi-camera application canbe utilized in a myriad of situations, such as large area surveillanceand ranging, for example.

An exemplary embodiment of the present disclosure also provides a methodfor delivering three-dimensional (3-D) content. The exemplary methodincludes receiving a first signal containing at least two-dimensional(2-D) content, and determining, in a processing unit of a computerizeddevice (e.g., the above-described processing unit), an amount of adifference in the content in the first signal to be visualized by a leftvisual sensor and a right visual sensor. The exemplary method alsoincludes determining, in the processing unit, whether the amount of thedifference is less than or equal to a predetermined minimum value.According to an exemplary embodiment, the predetermined minimum valuerepresents when one of the first visual sensor and the second visualsensor visualize the content in the first signal beyond a 3-D region ofspace into a 2-D region of space. In addition, the exemplary methodincludes discarding, in the processing unit, the first signal to bevisualized by one of the left visual sensor and the right visual sensorif the amount of the difference is determined to be less than or equalto the predetermined minimum value. Furthermore, the exemplary methodincludes generating, in the processing unit, a second signal containingthe 2-D content of the first signal and 3-D content in which the firstsignal to be visualized by the one of the left visual sensor and theright visual sensor is discarded.

Referring to FIGS. 6 and 7, the headache, discomfort and/ordisorientation problems with conventional 3-D systems will be addressedby the introduction of a Stereo Editing Expert System (SEES) 600, whichwill be achieved by artificial neural network (ANN) 605 processingand/or other artificial intelligence (AI) techniques. Also, incomputational-capable HDTV sets (or PCs, MIDs, PMPs, etc.), aviewer-related control can be provided to facilitate the desired orperceived degree of 3-D (and the resulting comfort level of the viewer)by simulating different interocular spacings (i.e., distances betweenthe viewer's eyes). For example, the above-described processing unit fordiscarding the redundant portion of the 2-D signal to be seen by leftand right visual sensors can be provided in such HDTV sets, PCs, MIDs,PMPs, etc. to process the received 2-D signal and generate the secondsignal containing the 2-D signal to be visualized by one of the visualsensors and 3-D content in which the common portion of the 2-D signal isdiscarded for the other one of the visual sensors.

The autonomous or semi-autonomous SEES 600 application program andgraphical user interface 701 will detect anomalies 606, 607 and alterthe content 706 during the electronic “editing” phase 601 or in the caseof live events, during the transmission phase 601. SEES functions as an“Editor's Best Practices Assistant” 700 that advises the human videoeditor on how to successfully avoid offensive 3-D effects by the dynamicand/or interactive application of techniques 608 such as deemphasizing3-D during certain transitions, for example. Detection of problems anddetermination of how to properly format the 3-D content 705 being editedwill be achieved by scanning 602, 603, 604, and 609 and analyzing 605,606, and 607 online or offline in real-time, near real-time, or in batchmode (at scene transitions 702 or other strategic locations) and/or byproviding guidance when actively sought by the human editor (e.g., bymaking a selection 704 from drop/pull-down menu(s) 703 or by selecting atransition/effect icon 707). The above-described processing unit canexecute the functions of the SEES 600 application program and cause thegraphical user interface 701 to be displayed on an appropriate displaydevice. As such, the processing unit, when scanning and analyzing thereceived 2-D signal can, by executing the SEES 600 application program,output a notification of anomaly (e.g., a discrepancy in 3-D content tobe displayed) via the graphical user interface 701 for correction of theanomaly. For example, when determining that an amount of a difference in3-D content to be visualized by a left visual sensor and a right visualsensor is less than or equal to a predetermined minimum value (e.g.,when one of the left visual sensor and the right visual sensor visualizethe 3-D content beyond a 3-D region of space into a 2-D region ofspace), the processing unit can output notification of an anomaly viathe graphical user interface 701 for correction of the anomaly, uponreceiving a corrective instruction from an operator. In accordance withan exemplary embodiment, the processing unit can also automaticallycorrect the anomaly, for example, by removing 3-D content to bedisplayed for a predetermined period of time (e.g., a fraction of asecond up to several seconds). As noted above, the predetermined minimumvalue is adjustable. For example, the processing unit can receive aninstruction to adjust the predetermined minimum value from an operatorvia the graphical user interface 701.

Accordingly, an exemplary embodiment of the present disclosure providesa method for enhancing 3-D content. The exemplary method includesdetermining, in a processing unit of a computerized device (e.g., aprocessor executing the SEES 600 application program), an amount of adifference in 3-D content to be visualized by a left visual sensor and aright visual sensor. The exemplary method includes determining, in theprocessing unit, whether the difference is less than or equal to apredetermined minimum value. According to an exemplary embodiment, thepredetermined minimum value represents when one of the right visualsensor and the left visual sensor visualize the content in the firstsignal beyond a 3-D region of space into a 2-D region of space. Theexemplary method also includes automatically outputting a notificationof an anomaly in the 3-D content if the difference is determined to beless than or equal to the predetermined minimum value. In addition, theexemplary method includes correcting the anomaly such that thedifference in the 3-D content is made to be less than the predeterminedminimum value.

Exemplary embodiments of the present disclosure also provide anon-transitory computer-readable recording medium having a computerprogram recorded thereon that causes a processor of a computing devicecarry out any of the above-described exemplary methods of the presentdisclosure.

While it is an objective of the exemplary device and method of thepresent disclosure to be 100% compatible with existing television,computer, mobile and other display systems, special Head Endtransmission equipment may be required.

Perhaps viewer satisfaction will be optimized when special cameras areused to record 3-D programs. For example, communicating lenses may beused to more accurately mimic how human eyes capture 3-D scenes.

There appear to be some similarities between the Stereo 3-D bandwidthproblem and the transmission of high-definition television (HDTV), wetherefore assert that some or all of the solutions of the exemplaryembodiments of the present disclosure will apply to HDTV.

It will be appreciated by those skilled in the art that the presentinvention can be embodied in other specific forms without departing fromthe spirit or essential characteristics thereof. The presently disclosedembodiments are therefore considered in all respects to be illustrativeand not restricted. The scope of the invention is indicated by theappended claims rather than the foregoing description and all changesthat come within the meaning and range and equivalence thereof areintended to be embraced therein.

What is claimed is:
 1. A device for delivering three-dimensional (3-D)content, the device comprising: a receiving unit configured to receive afirst signal containing at least two-dimensional (2-D) content; and aprocessing unit configured to: determine an amount of a difference inthe content in the first signal to be visualized by a left visual sensorand a right visual sensor, determine whether the amount of thedifference is less than or equal to a predetermined minimum value, andto discard a portion of the first signal to be visualized by one of theleft visual sensor and the right visual sensor corresponding to theamount of the difference when the amount of the difference is determinedto be less than or equal to the predetermined minimum value; thepredetermined minimum value representing when one of the first visualsensor and the second visual sensor visualize the content in the firstsignal beyond a 3-D region of space into a 2-D region of space; andgenerate a second signal containing the 2-D content of the first signaland 3-D content in which the portion of the first signal to bevisualized by the one of the left visual sensor and the right visualsensor is discarded.
 2. The device according to claim 1, comprising: atransmitting unit configured to transmit the second signal to at leastone of a 2-D enabled device and a 3-D enabled device.
 3. The deviceaccording to claim 1, wherein the receiving unit is configured toreceive the first signal from a legacy signal source including at leastone of satellite, RF cable, fiber optics, terrestrial RF and theInternet.
 4. The device according to claim 1, wherein the receiving unitis comprised in a head end.
 5. The device according to claim 4, whereinthe processing unit is comprised in a head end.
 6. The device accordingto claim 4, wherein the processing unit is comprised in a multimediadevice configured to display the second signal.
 7. The device accordingto claim 6, wherein the multimedia device configured to display thesecond signal is at least one of a television, a computer, a mobileInternet device, and a portable media player.
 8. The device according toclaim 1, wherein the processing unit is configured to convert thecontent in the first signal into 3-D content contained in the secondsignal.
 9. The device according to claim 2, wherein the transmittingunit is configured to transmit the 2-D content of the first signalcontained in the second signal to a 2-D enabled device, and to transmitthe 3-D content in the second signal to a 3-D enabled device.
 10. Thedevice according to claim 2, wherein the transmitting unit is configuredto transmit the 2-D content of the first signal and transmit the 3-Dcontent in the second signal on the same communication channel.
 11. Thedevice according to claim 2, wherein the transmitting unit is configuredto transmit the 2-D content of the first signal on a first communicationchannel and transmit the 3-D content in the second signal on a secondcommunication channel distinct from the first communication channel. 12.The device according to claim 2, comprising: a compression unitconfigured to compress the second signal according to a predeterminedcompression technique, wherein the transmitting unit is configured totransmit the compressed second signal.
 13. The device according to claim1, wherein the first signal received by the receiving unit includes tworelated 2-D signals collectively constituting 3-D content.
 14. Thedevice according to claim 1, comprising: a recording unit configured torecord the second signal onto a non-transitory recording medium.
 15. Thedevice according to claim 14, comprising: a compression unit configuredto compress the second signal according to a predetermined compressiontechnique, wherein the recording unit is configured to record thecompressed second signal onto the non-transitory recording medium. 16.The device according to claim 1, wherein the processing unit isconfigured to generate information identifying the common portionincluded in the second signal for reconstruction of the second signal ina 3-D enabled device.
 17. The device according to claim 1, wherein theprocessing unit is configured to enhance the 3-D content included in thesecond signal by: determining an amount of a difference in the 3-Dcontent to be visualized by the left visual sensor and the right visualsensor; determining whether the difference is less than or equal to thepredetermined minimum value; automatically outputting a notification ofan anomaly in the 3-D content when the amount of the difference isdetermined to be less than or equal to the predetermined minimum value;and correcting the anomaly such that the difference in the 3-D contentis made to be less than the predetermined minimum value.
 18. The deviceaccording to claim 1, wherein the predetermined minimum value isadjustable.
 19. The device according to claim 1, comprising: atransmitting unit configured to transmit the second signal to areceiving device via at least one of a wired and wireless transmissionmedium.
 20. The device according to claim 19, comprising: a compressionunit configured to compress the second signal according to apredetermined compression technique, wherein the transmitting unit isconfigured to transmit the compressed second signal.
 21. A device fordelivering three-dimensional (3-D) content, the device comprising: areceiving unit configured to receive a first signal containing at leasttwo-dimensional (2-D) content; and a processing unit configured to:determine an amount of a difference in the content in the first signalto be visualized by a left visual sensor and a right visual sensor;determine whether the amount of the difference is less than or equal toa predetermined minimum value, and to discard a portion of the firstsignal to be visualized by one of the left visual sensor and the rightvisual sensor corresponding to the amount of the difference when theamount of the difference is determined to be less than or equal to thepredetermined minimum value; and generate a second signal containing the2-D content of the first signal and 3-D content in which the portion ofthe first signal to be visualized by the one of the left visual sensorand the right visual sensor is discarded; wherein the left visual sensoris a first visual sensor, the right visual sensor is a second visualsensor, and the first signal received by the receiving unit contains 2-Dcontent to be visualized by the first visual sensor, the second visualsensor, and a third visual sensor, and wherein the processor isconfigured to: determine an amount of a first difference in the contentin the first signal to be visualized by the first visual sensor and thesecond visual sensor; determine an amount of a second difference in thecontent in the first signal to be visualized by the second visual sensorand the third visual sensor; determine an amount of a third differencein the content in the first signal to be visualized by the first visualsensor and the third visual sensor; determine whether the amount of thefirst difference is less than or equal to the predetermined minimumvalue, and discard a portion of the first signal to be visualized by oneof the first visual sensor and the second visual sensor corresponding tothe amount of the first difference when the amount of the firstdifference is determined to be less than or equal to the predeterminedminimum value; determine whether the amount of the second difference isless than or equal to the predetermined minimum value, and discard aportion of the first signal to be visualized by one of the second visualsensor and the third visual sensor corresponding to the amount of thesecond difference when the amount of the second difference is determinedto be less than or equal to the predetermined minimum value; determinewhether the amount of the third difference is less than or equal to thepredetermined minimum value, and discard a portion of the first signalto be visualized by one of the first visual sensor and the third visualsensor corresponding to the amount of the third difference when theamount of the third difference is determined to be less than or equal tothe predetermined minimum value; and generate the second signal tocontain the 2-D content of the first signal and 3-D content in which theportion of the first signal to be visualized by the one of the firstvisual sensor and the second visual sensor is discarded, the portion ofthe first signal to be visualized by the one of the second visual sensorand the third visual sensor is discarded, and the portion of the firstsignal to be visualized by the one of the first visual sensor and thethird visual sensor is discarded.
 22. A method for deliveringthree-dimensional (3-D) content, the method comprising: receiving afirst signal containing at least two-dimensional (2-D) content;determining, in a processing unit of a computerized device, an amount ofa difference in the content in the first signal to be visualized by aleft visual sensor and a right visual sensor, determining, in theprocessing unit, whether the amount of the difference is less than orequal to a predetermined minimum value; the predetermined minimum valuerepresenting when one of the first visual sensor and the second visualsensor visualize the content in the first signal beyond a 3-D region ofspace into a 2-D region of space; discarding, in the processing unit, aportion of the first signal to be visualized by one of the left visualsensor and the right visual sensor corresponding to the amount of thedifference when the amount of the difference is determined to be lessthan or equal to the predetermined minimum value; and generating, in theprocessing unit, a second signal containing the 2-D content of the firstsignal and 3-D content in which the portion of the first signal to bevisualized by the one of the left visual sensor and the right visualsensor is discarded.
 23. The method according to claim 22, comprising:transmitting the second signal to at least one of a 2-D enabled deviceand a 3-D enabled device.
 24. The method according to claim 23, whereinthe transmitting of the second signal comprises: transmitting the 2-Dcontent of the first signal contained in the second signal to the 2-Denabled device, and transmitting the 3-D content in the second signal tothe 3-D enabled device.
 25. The method according to claim 22, whereinthe predetermined minimum value represents when one of the first visualsensor and the second visual sensor visualize the content in the firstsignal beyond a 3-D region of space into a 2-D region of space.
 26. Themethod according to claim 22, comprising: recording the second signalonto a non-transitory recording medium.
 27. The method according toclaim 22, comprising enhancing the 3-D content included in the secondsignal, the enhancing of the 3-D content comprising: determining anamount of a difference in the 3-D content to be visualized by the leftvisual sensor and the right visual sensor; determining whether thedifference is less than or equal to the predetermined minimum value;automatically outputting a notification of an anomaly in the 3-D contentwhen the amount of the difference is determined to be less than or equalto the predetermined minimum value; and correcting the anomaly such thatthe difference in the 3-D content is made to be less than thepredetermined minimum value.
 28. The method according to claim 22,wherein the predetermined minimum value is adjustable.
 29. Anon-transitory computer-readable recording medium having a computerprogram recorded thereon that causes a processor of computing device todeliver three-dimensional (3-D) content, the program causing theprocessor to execute operations comprising: receiving a first signalcontaining at least two-dimensional (2-D) content; determining an amountof a difference in the content in the first signal to be visualized by aleft visual sensor and a right visual sensor; determining whether theamount of the difference is less than or equal to a predeterminedminimum value, the predetermined minimum value representing when one ofthe first visual sensor and the second visual sensor visualize thecontent in the first signal beyond a 3-D region of space into a 2-Dregion of space; discarding a portion of the first signal to bevisualized by one of the left visual sensor and the right visual sensorcorresponding to the amount of the difference when the amount of thedifference is determined to be less than or equal to the predeterminedminimum value; and generating a second signal containing the 2-D contentof the first signal and 3-D content in which the portion of the firstsignal to be visualized by the one of the left visual sensor and theright visual sensor is discarded.
 30. The computer-readable recordingmedium according to claim 29, wherein the predetermined minimum valuerepresents when one of the first visual sensor and the second visualsensor visualize the content in the first signal beyond a 3-D region ofspace into a 2-D region of space.
 31. The computer-readable recordingmedium according to claim 29, wherein the predetermined minimum value isadjustable.
 32. A method for enhancing three-dimensional (3-D) content,the method comprising: determining, in a processing unit of acomputerized device, an amount of a difference in 3-D content to bevisualized by a left visual sensor and a right visual sensor;determining, in the processing unit, whether the difference is less thanor equal to a predetermined minimum value, the predetermined minimumvalue representing when one of the first visual sensor and the secondvisual sensor visualize the content in the first signal beyond a 3-Dregion of space into a 2-D region of space; automatically outputting anotification of an anomaly in the 3-D content when the amount of thedifference is determined to be less than or equal to the predeterminedminimum value; and correcting the anomaly such that the difference inthe 3-D content is made to be less than the predetermined minimum value.33. The method according to claim 32, wherein the predetermined minimumvalue represents when one of a first visual sensor and a second visualsensor visualize the 3-D content beyond a 3-D region of space into a 2-Dregion of space.
 34. The method according to claim 32, wherein thecorrecting of the anomaly comprises automatically correcting theanomaly.
 35. The method according to claim 32, wherein the correcting ofthe anomaly comprises correcting the anomaly upon receiving a correctiveinstruction from an operator.
 36. The method according to claim 32,wherein the predetermined minimum value is adjustable.
 37. Anon-transitory computer-readable recording medium having a computerprogram recorded thereon that causes a processor of computing device toenhance three-dimensional (3-D) content, the program causing theprocessor to execute operations comprising: determining an amount of adifference in 3-D content to be visualized by a left visual sensor and aright visual sensor; determining whether the amount of the difference isless than or equal to a predetermined minimum value, the predeterminedminimum value representing when one of the first visual sensor and thesecond visual sensor visualize the content in the first signal beyond a3-D region of space into a 2-D region of space; automatically outputtinga notification of an anomaly in the 3-D content when the amount of thedifference is determined to be less than or equal to the predeterminedminimum value; and correcting the anomaly such that the difference inthe 3-D content is made to be less than the predetermined minimum value.38. The computer-readable recording medium according to claim 37,wherein the predetermined minimum value represents when one of a firstvisual sensor and a second visual sensor visualize the 3-D contentbeyond a 3-D region of space into a 2-D region of space.
 39. Thecomputer-readable recording medium according to claim 37, wherein thepredetermined minimum value is adjustable.